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Abstract 

The Douglas-Rachford algorithm is a classical and very successful method for solving 
optimization and feasibility problems. In this paper, we provide novel conditions suffi¬ 
cient for finite convergence in the context of convex feasibility problems. Our analysis 
builds upon, and considerably extends, pioneering work by Spingarn. Specifically, we 
obtain finite convergence in the presence of Slater's condition in the affine-polyhedral 
and in a hyperplanar-epigraphical case. Various examples illustrate our results. Numer¬ 
ical experiments demonstrate the competitiveness of the Douglas-Rachford algorithm 
for solving linear equations with a positivity constraint when compared to the method 
of alternating projections and the method of reflection-projection. 
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1 Introduction 


Throughout this paper, we assume that 

X is a finite-dimensional real Hilbert space (1) 

with inner product (•, •) and induced norm || • ||, and 

A and B are closed convex subsets of X such that ACiB 0. (2) 

Consider the convex feasibility problem 

find a point in A fl B (3) 

and assume that it is possible to evaluate the projectors (nearest point mappings) Pa and Pg 
corresponding to A and B, respectively. We denote the corresponding reflectors hy Ra 
2Pa — Id and Rg ■= 2 Pb — Id, respectively. Projection methods combine the projectors and 
reflectors in a suitable way to generate a sequence converging to a solution of (|^ — we refer 
the reader to |i2|, |;8|, and |9| and the references therein for further information. 

One celebrated algorithm for solving (|^ is the so-called Douglas-Rachford Algorithm (DRA) 
llTTH . The adaption of this algorithm to optimization and feasibility is actually due to Lions 
and Mercier was laid out beautifully in their landmark paper lH^ (see also IIT2l L The DRA is 
based on the Douglas-Rachford splitting operator, 

T:= Id-P a+ PbRa. (4) 

which is used to generate a sequence {z„)neK with starting point Zq G X via 

(Vn G N) z„+i := Tz„. (5) 

Then the "governing sequence" {z„)net^ converges to a point z G FixT, and, more impor¬ 
tantly, the "shadow sequence" {PAZnjneK converges to PaZ which is a solution of 

An important question concerns the speed of convergence of the sequence (P, 4 Z„)„g]N. 
Linear convergence was more clearly understood recently, see IIT4ll . ll2T] . and |6|. 

The aim of this paper is to provide verifiable conditions sufficient for finite convergence. 

Our two main results reveal that Slater's condition, i.e., 

A n int B 7 ^ 0 (6) 

plays a key role and guarantees finite convergence when (MRl) A is an affine subspace 
and B is a polyhedron (Theorem |3.7| l; or when (MR2) A is a certain hyperplane and B is an 
epigraph (Theorem |5.4| |. Examples illustrate that these results are applicable in situations 
where previously known conditions sufficient for finite convergence fail. When specialized 


2 


to a product space setting, we derive a finite convergence result due to Spingarn II26I for 
his method of partial inverses II25H . Indeed, the proof of Theorem |3.7| follows his pioneering 
work, but, at the same time, we simplify his proofs and strengthen the conclusions. These 
sharpenings allow us to obtain finite-convergence results for solving linear equations with 
a positivity constraint. Numerical experiments support the competitiveness of the DRA for 
solving (|^. 


Organization of the paper 

The paper is organized as follows. In Section we present several auxiliary results which 
make the eventual proofs of the main results more structured and transparent. Section 
contains the first main result (MRl). Applications using the product space set up, a compar¬ 
ison with Spingarn's work, and numerical experiments are provided in Section]^ The final 
Section [^concerns the second main result (MR2). 


Notation 

The notation employed is standard and follows largely |2j. The real numbers are R, and the 
nonnegative integers are N. Further, R_|_ :={xGR|x> 0} and R++ :={xGR|x> 0}. 
Let C be a subset of X. Then the closure of C is C, the interior of C is int C, the boundary 
of C is bdry C, and the smallest affine and linear subspaces containing C are, respectively, 
affC and spanC. The relative interior of C, riC, is the interior of C relative to affC. The 
orthogonal complement of C is C“*“ := {y G X | (Vx G C) {x,y) = O}, and the dual cone of 
C is C® := {y G X I (Vx G C) (x,y) > O}. The normal cone operator of C is denoted by Nq, 
i.e., Nc(x) = {y G X I (Vc G C) (y,c — x) < 0} if x G C, and Nc(x) = 0 otherwise. If x G X 
and p G R++, then ball(x;p) := {y G X | ||x — y|| < p] is the closed ball centered at x with 
radius p. 


2 Auxiliary results 


In this section, we collect several auxiliary results that will be useful in the sequel. 


2.1 Convex sets 

Lemma 2.1 Let C be a nonempty closed convex subset of X, let x G X, and let y E C. Then 
X — Pqx g Nc(y) (x — Pcx,y — Pqx) — 0. 

Proof. Because y E C and x — PcX E Nc(Pcx), we have (x — PcX,y — Pcx) < 0. From 

X — Pcx E Nc{y) and Pqx E C, we have (x — Pcx, Pqx — y) <0. Thus (x — Pcx, Pqx — y) = 
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0. We have (Vc e C) {x — Pcx,c — y) = {x — Pcx,c — Pqx) + {x — Pcx,Pcx — y) — 

{x — Pcx,c — Pqx) < 0. Hence x — Pqx G Nc{y)- ■ 

Lemma 2.2 Let Che a nonempty convex subset ofX. Then int C 7 ^ 0 0 G int(C — C). 

Proof. "=^": Clear. By |22l Theorem 6.2], ri C 7 ^ 0. After translating the set if necessary, 
we assume that 0 G riC. Then 0 G C, and so Y ;= aff C = spanC. Since 0 G int(C — C) C 
int(span C) = int Y, this gives int Y 7 ^ 0 and thus Y = X. In turn, int C = ri C 7 ^ 0 . ■ 


2.2 Cones 

Lemma 2.3 Let Kbea nonempty convex cone in X. Then there exists y G ri X n ri X® such that 

(VxGX\(Xn(-X))) (i;,x)>0. (7) 

Proof. By |26l Lemma 2], there exists f G ri X n ri X®. Then f G ri X® = ri X®. Noting that X 
is a closed convex cone and using Il26l Lemma 3], we complete the proof. ■ 

Lemma 2.4 Let be a sequence in X, and let f: X ^ Kbe linear. Assume that z„ ^ z E X, 

and that 

(VnGN) /(z„) >/(z„+i). (8) 

Then there exist no G N \ {0} and {pi,.. .,p.no) € 1R+ such that Pk — ^ 

j no no \ 

{ E Pk(zk-i - Zk), Pk{zk -z))>0. (9) 

\k=l k=l 


(flnE'H\{Q}) yn ■.= Zn-l - Zn, 


Proof. Introducing 
we get 

(Vn G N \ {0}) f{yn) > 0, and so i/„ f= 0. 

Let X be the convex cone generated by {i/n}„ 6 ]N\{o}- We see that 

{VxeK\ {0}) fix) > 0, and (Vx G -X \ {0}) /(x) < 0. 

Therefore, 

xn(-x) c {xgx|/(x) = o}. 

Setting 

(Vn G N \ {0}) w„ z„ — z, 
we immediately have zvn —?■ 0 , and so 

00 00 

(Vn G N \ {0}) ZVn=Zn-Z= Y i^k-1 “ Zfc) = Y Vk ^ K- 

k=n-\-l k=n-\-l 


( 10 ) 

( 11 ) 

( 12 ) 

(13) 

(14) 

(15) 
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( 16 ) 


From ^ we get 
Moreover, f(wn) 


(Vn G N \ {0}) f{w„) > f{wn+i). 
/(O) = 0, hence 

(Vn e N \ {0}) f{wn) > 0. 


Together with ( [13| ) and ( |15| |, this gives 

(VnG N\{0}) w„ eK^{Kn{-K)). 


By Lemma 2.3 there exists n G ri K n ri K® such that 

(Vn G N \ {0}) {v,zvn) > 0. 


(17) 

(18) 

(19) 


Then we must have v 0. Since v E K, after scaling if necessary, there exist no G N \ {0} 
and (ni ,..., jino) € K+ such that 


no 


no 


^ = E and = 

k=l k=l 


This combined with ( [T^ implies 


flQ flQ 


{ E E ) > 0, 

\k=i k=i / 

and so 0 holds. 

Lemma 2.5 Let K be a nonempty pointeJ^convex cone in X. Then the following hold: 


( 20 ) 


( 21 ) 


(i) Let m G N \ {0} and let (xi,..., %„) G K’”. Then xi +-h x^ = 0 xi = • • • = x^ = 

0 . 

(ii) If K is closed and L: X ^ X is linear such that 

kerLnfC = {0}, (22) 

then L(K) is a nonempty pointed closed convex cone. 

Proof 1^ Assume that Xi + • • • + x^ = 0. Then since X is a convex cone, 

— Xi = X2 + • • • + Xm G K, (23) 

and so Xi G X H (—X). Since X is pointed, we get Xi = 0. Continuing in this fashion, we 
eventually conclude that Xi = • • • = x,m = 0. The converse is trivial. 

Since X is a closed convex cone, so is M := L(X) due to assumption ( |^ and IZl 
Proposition 3.4]. Now let z G M H (— M). Then z = L(r) = —L(s) for some points r,s in X. 
Thus L{r + s) — L{r) + L(s) = 0, which gives r + s G ker L, and so r + s G ker L n X. By 
again ( [2^ , r + s = 0, and now [(i)] implies r = s = 0. Therefore, z = 0, and M is pointed. ■ 

^Recall that a cone K is pointed if R fl {—K) C {0}. 


(ii) 
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Lemma 2.6 Let {an)neK be a sequence in X such that Un ^ a E X, and K be a pointed closed 
convex cone ofX. Assume that 


(3 p 6 N) ap — a and (Vn > p) a„ — a„^i E K. 


(24) 


Then 


(Vn > p) an = a. 


(25) 


Proof. Since X is a closed convex cone and a„ —)■ a, it follows from ([24]) that 


OO 


(Vn > p) fl„-fl = ^(afc-flfc+i) G X, 


(26) 


k=n 


and so flp+i — a E K. Since ap — a, ( [^ gives a — flp+i G K. Noting that K is pointed, this 
implies flp+i — a E KD {—K) C {0}, and hence flp+i = a. Repeating this argument, we get 


the conclusion. 


2.3 Locally polyhedral sets 

Definition 2.7 (local polyhedrality) Let Che a subset ofX. We say that C is polyhedral at c G C 
if there exist a polyhedra^set D and e E IR++ such that C D ball(c; e) = D n ball(c; e). 

It is clear from the definition that every polyhedron is polyhedral at each of its points and 
that every subset C of X is polyhedral at each point in int C. 

Lemma 2.8 Let C be a subset of X, and assume that C is polyhedral at c E C. Then there exist 
e G 1R++, a finite set I, {di)i^i G (X \ {0})^ G IR^ such that 



(27) 


(Vi G I) {di,c) — Si, and 

(Vy G Cnball(c;£)) Nc(y) = Yh where I(y) := {i G f | {di,y) = Si}. (28) 


Proof. Combine Lemma 2.12 with l24l Theorem 6.46]. 


Lemma 2.9 Let C be a nonempty closed convex subset ofX that is polyhedral at c E C. Then there 
exists e E 1R++ such that 


(Vx G P(;^(Cnball(c;£))) {x — Pcx,c — Pcx) = 0 and x — PcxENcic). (29) 


^Recall that a set is polyhedral if it is a finite intersection of halfspaces. 


6 





Proof. We adopt the notation of the conclus ion o f Lemma [Z 8 | Let x E X such that y := Pcx E 
ball(c;e). Then x — y E Nc{y) and Lemma 2.8 guarantees the existence of {K)iei{x) ^ 


such that 


Then 




(30) 


{x-y,c-y)^ ^ Xi{di,c-y)^ ^ A/((d/,c) - (di,y)) = ^ \fSi-Si)^0 (31) 

i€i{y) i^Py) i^Py) 


and so {x — Pqx, c — Pcx) = 0. Furthermore, by Lemma 2.1. x — Pqx E Nc{c). 


2.4 Two convex sets 


Proposition 2.10 Let A and B be closed convex subsets of X such that ADB 0. Then the 
following hold: 


(i) (Vfl e A)(yb E B) NA-Bia -b)^ NAia) n ( - Nsib)). 

(ii) 0 G int(A -B) ^ Na-b{0) = {0}. 

(iii) intB ^0 ^ (Px E B) Nb{x) H {-Nb{x)) = {0}. 


Proof Noting that N-si—b) = —Nsib) by definition, the conclusion follows from EHl 
Proposition 2.11(ii)] or from a direct computation. |(ii)| Clear from O Corollary 6.44]. |(iii) 


Let X E B. By[^ Nb{x) fl (—Nb(x)) = Nb_b(0). Now Lemma 2.2 and |(ii)| complete the 
proof. ■ 


Corollary 2.11 Let Abe a linear subspace ofX, and let B be a nonempty closed convex subset ofX 
such that ACiB 0. Then the following hold: 


(i) 0 e int(A - B) ^ [(Vx G A n B) n Nb(x) = {0}]. 

(ii) AnintB 7^0 [O G int(A — B) and intB ^ 0 ]. 


Proof 1^ Let x G A fl B. Since A is a linear subspace, Froposition |2.1C]|^i) yields 
A^ n Nb{x) = -{Na{x) n (-Nb(x))) = -Na-b{0). 

Now apply Proposition 2. im 


(32) 


If 0 G int(A — B) and intB 7 ^ 0 , then 0 G ri(A — B) and riB = intB. Since A is a 
linear subspace, we have ri A = A, and using Il22l Corollary 6.6.2], we get 


0 G ri(A - B) = ri A - ri B = A - int B, 
which implies A H int B 7 ^ 0 . The converse is obvious. 


(33) 
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Lemma 2.12 Let A and B be closed convex subsets of X, and let c E An B and e E ]R++ be such 
that A r\hall{c;e) = B nball(c;£). Then Na{c) = Nb{c). 

Proof. Let u E X. Working with the directional derivative and using O Proposition 17.17(i)], 
we have u E Na{c) = diA^c) (V/i G X) {u,h) < (V/i G X) {u,h) < i'g{c;h) 

u E Nsic) ^ disic). ■ 


2.5 Monotone operators 

Lemma 2.13 Let L: X x X —> X x X: (x, y) (LuX + Li2y, L21X + L22I/), where each Lij : X ^ 
X is linear. Assume that 1^^122 + L|jLi 2 = Id and that 1^^121 and L 22 L 12 are skeu^ Then the 
following hold: 

(i) lf{x,y) G Xx Xand (u,v) — L{x,y), then {u,v) — {x,y). 

(ii) Let M: X ^ X be a monotone operator, and define Mi: X X via graM^, = L(graM). 
Then for all pairs {x,y) and {x' ,y') in graM and {u,v) — L(x,y), {u',v') — L{x',y'), we 
have {u — v,u' — v') = {x — x',y — y'); consequently, Mi is monotone. 

Proof. 1^ The assumptions indeed imply 


{u,v) — (Liix + Li2y, L21X + L221/) 

= {x, {L*uL22 + L*2iLi2)y) + (x, LtiL2ix) + {y, L|2Li2y) = (x,y). 


(34a) 

(34b) 


(ii) Since (x — x',y — y') = (x,y) — (x',y') and L is linear, the result follows from[^ 


Corollary 2.14 Let Abe a linear subspace ofX, and let (x,y) and (x',y') be in X x X. Then the 
following hold: 


(i) (PaP - Pa±x, Pax - Pa^p) = (y, x) 

(ii) {{PaP - Pa±x) - [PaP' - Pa^^'), (Pax - Py^±y) - (P^x' - PA±y')) = (y - y', x - x'). 


Proof. Set Lii = L 22 = Pa and L 12 = L 21 = —Pa^ in Lemma 2.13[ 


Remark 2.15 Spingarn's original partial inverse ||25l arises from Lemma|2.13|by setting Ln = 
T 22 = Pa and L 12 = L 21 = P^± while in in Corollary 2.14| we used Ln = L 22 = Pa and 
Li 2 = L 21 = —Pa.:-- Other choices are possible : e.g. , if X = and R denotes the clockwise 


rotator by 7r/4, then a valid choice for Lemma 
^Recall that S: X —X is skew if S* = —S. 


2.13 


is Lii — L 22 — 2 ^ and L 12 — L 21 = ^R* 
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2.6 Finite convergence conditions for the proximal point algorithm 


It is known (see, e.g., IIT^ Theorem 6]) that the DRA is a special case of the exact proximal 
point algorithm (with constant parameter 1). The latter generates, for a given maximally 
monotone operator M: X ^ X with resolvent T := Jm = (Id +M)“^, a sequence by 


zq G X, (Vn G N) Zn+i := Tzn = (Id+M)“^z„, (35) 

in order to solve the problem 

find z G X such that 0 G Mz; equivalently, z G Fix T. (36) 

A classical sufficient condition dates back to Rockafellar (see 1231 Theorem 3]) who proved 
finite convergence when 

(3z G X)(3^5 G ]R++) hall{0)S) C Mz. (37) 

It is instructive to view this condition from the resolvent side: 

(3z G X)(3^5 G R++)(Vz G X) ||z-z||<^5^ Tz = z. (38) 

Note that since Fix T is convex, this implies that 

Fixr= {z} (39) 


is a singleton, which severely limits the applicability of this condition. 

Later, Tuque (see ITTl Theorem 3.2]) proved finite convergence under the more general 
condition 

M“^0 ^ 0 and (3 <5 e IR++) M“^ (ball(0;^)) C M“^0. (40) 

On the resolvent side, his condition turns into 

Fix T 7^ 0 and > 0) ||z - Tz|| < Tz G Fix T. (41) 

However, when M“^0 = FixT ^ 0, it is well known that Zn — Tzn 0; thus, the finite- 
convergence condition is essentially a tautology. 

When illustrating our main results, we shall provide examples where both ( [^ and ( [40| ) 
fail while our results are applicable (see Remark [3^ and Example |5.5| below). 


2.7 Douglas-Rachford operator 

For future use, we record some results on the DRA that are easily checked. Recall that, for 
two nonempty closed convex subsets A and B, the DRA operator is 

T := Id -Pa + Pb{2Pa - M) = ^ (Id +RbRa) • (42) 


The following result, the proof of which we omit since it is a direct verification, records 
properties in the presence of affinity/linearity. 
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Proposition 2.16 Let A be an affine subspace of X and let B be a nonempty closed convex subset of 
X. Then the following hold: 

(i) Pa is an affine operator and 

Pa^a = Pa/ PaT = PaPbPa and T = {Pa + Pb — (43) 

(ii) If A is a linear subspace, then Pa is a symmetric linear operator and 

T = {PaPb - -Pb))Ra- (44) 

The next result will be used in Section [4T] below to clarify the connection between the DRA 
and Spingam's method. 

Lemma 2.17 Let A be a linear subspace of X, let B be a nonempty closed convex subset of X, let 
(fl,fl“*“) € A X A“*“, and set {a-^-,af) {PaPb{^ + <^“*“)/P/i-'-(Id —PB)(fl + fl“*“)) E A x A'^. Then 
T{a — a-^) = — af. 

Proof. Clearly, a+ G A and af G A-*-. Since Ra{(i — = (Pa — PaJ-)(^ “ the 

conclusion follows from ([ii]). ■ 


3 The affine-polyhedral case with Slater's condition 


In this section, we are able to state and prove finite convergence of the DRA in the case where 
A is an affine subspace and B is a polyhedral set such that Slater's condition, A n int B ^ 0 , 
is satisfied. We start by recalling our standing assumptions. We assume that 

X is a finite-dimensional real Hilbert space, (45) 

and that 


A and B are closed convex subsets of X such that A n B 7 ^ 0 . (46) 

The DRA is based on the operator 


T ;= Id —Pa + PbRa- 


Given a starting point Zq G X, the DRA sequence {zn)neN is generated by 

(Vn G N) Zn+i := Tz„. 

We also set 


if/n G ]bJ) a^ I— PA^nr •— Ra^ti — 

We now state the basic convergence result for the DRA. 


(47) 


(48a) 

(48b) 
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( 49 ) 


Fact 3.1 (convergence of the DRA) The DRA sequences ( |48l l satisfy 

Zn ^ z e FixT = {A n B) + Na-b{ 0) (ind % ^ Paz G A n B. 

Proof. Combine ||3l Corollary 3.9 and Theorem 3.13]. ■ 


Fact 3.1 can be strengthened when a constraint qualification is satisfied. 


Lemma3.2 Suppose that 0 G int(A — B). Then there exists a point c E ACiB such that the 
following hold for the DRA sequences ( |4^ ; 


(i) ri(A) n ri(B) 0 and hence (z„)„g]N, (fln)neN {rn)n€f^ converge linearly to c. 

(ii) Ifc G int B, then the convergence of (z„)„g]N, (fl„)nGN ‘^nd (r„)„g]N to c is finite. 


Proof, (i) From 0 G int(A — B), we have N^_b( 0) = {0} due to Proposition |2.10[ This gives 
Fix T = A n B, and Fact |3.1| implies Zn ^ c G A n B and > P^c = c. Then r„ = 2a„ —Zn^ 
c. Using again 0 G int(A — B), 1221 Corollary 6.6.2] yields 0 G ri(A — B) = ri A — riB, and 
thus riA n riB 7 ^ 0. Now the linear convergence follows from ETl Theorem 4.14] or from 
JH Theorem 8.5(i)]. 


(ii) Since > c and a„ —> c by|^ there exists n G N such that r„ E B and a„ E B. Then 


PsTn = rn and 


Zn+l = Zn — fln + PbN = z„ — a„ + Tn = An G A fl B = Fix T. (50) 

Hence = z„_|_i = z „+2 = • • • and we are done. ■ 

Lemma 3.3 Suppose that A is a linear subspace. Then the DRA sequences ( |48l l satisfy 

a„ = Paz„ = PaTu and = PaTz„ = PaPePaZh = PAPsrn, (51) 

and 

(VnGN) an-an+i = PA{rn-PBrn)- (52) 


Proof. Clear from ( |43] ). Use ( [^ and the linearity of P^. ■ 

Lemma 3.4 Suppose that A is a linear subspace and that for the DRA sequences < |48] l there exists 
p G N such that ap = flp+i = c G A fi B, and that there is a subset N ofX such that rp — PBrp E N 
and A-*- ON = {0}. Then (Vn > p + 1) z„ = c. 

Proof. Since ap — flp+i = 0, ( |^ implies rp — Pgrp E A-*- DN — {0}. Thus Pgrp — rp and 
therefore Zp+i =Zp — ap + rp = ap = cEADBQ Fix T. ■ 
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Lemma 3.5 Suppose that A is a linear subspace and let a e A. Then the DRA sequence 
satisfies 

(Vn e N) (z„ - Zn+l, Zn+l - fl) = (r„ - PsTn, PBrn “ «) , 


(53a) 


and 


(Vn e N)(Vm e N) (z„+i - z^+i, (z„ - z„+i) - (z^ - z^+i)) > 0. (53b) 


Proof. Let n 6 N. Using we find that 

Z„ - Zn+l =an- Psrn = ^Arn “ Psrn = ^AiTn “ PBrn) “ PA^iPsrn “ «)• (54) 

Next, ( [44| | yields 

z„+i -a = PAPsrn - Pa^ i^n - Psrn) -a = PAiPsrn -a)- P^i {r„ - PBrn). (55) 

Moreover, r„ — Pgrn G NsiPBrn) = NB-aiPsrn — «) and Ns-a is a monotone operator. The 
result thus follows from Corollary |2.14| ■ 

Lemma 3.6 Suppose that A is a linear subspace and that the DRA sequences ( |48l l satisfy 

Zn ^ a e A and (Vn G N) {r„ — PBrn,a — PBr„) = 0. (56) 

Then there is no linear functional /: X ^ R such that 

(Vn G N) f{zn) > f{Zn+l). (57) 


Proof. Suppose to the contrary that there exists a linear function / ; X ^ R satisfying ( [57| |. 
Now set 

(Vn G N \ {0}) yn := z„_i — Zn and zvn := z„ — a. (58) 

On the one hand. Lemma [zi] yields no G N \ {0} and {pi,..., pno) ^ such that 

«0 / ”0 «0 \ 

J^Pk = '^ and ( ^ V'kVkf E PkWk ) > 0. (59) 

fc=i \k=i k=i / 

On the other hand. Lemma [33| and ( [^ yield 


(Vfc G N \ {0})(V/ G N \ {0}) {yk,'^k) = 0 and {pk — yj,Wk — wf) > 0; 

consequently, with the help of |21 Lemma 2.13(i)], 

/no no \ no no no 

(E E ) = YLp^ ^ E E p^pi {y^ ~ yt' ~^i) ^ o- 


\k=l 


k=l 


k=l 


k^lj^l 


Comparing ( [^ with we arrive at the desired contradiction. 


(60) 


(61) 


We are now ready for our first main result concerning the finite convergence of the DRA. 
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Theorem 3.7 (finite convergence of DRA in the affine-polyhedral case) Suppose that A is a 
affine subspace, that B is polyhedral at every point in A n bdry B, and that Slater's condition 

A n int B 7 ^ 0 (62) 

holds. Then the DRA sequences (|48l) converge in finitely many steps to a point in A OB. 


Proof After translating the sets if necessary, we can and do assume that A is a linear subspace 
of X. By Corollary |2.11||^ii)| ( |^ yields 


0 6 int(A — B) and intB 7 ^ 0 . 


(63) 


Lemma 3.2 'i) thus implies that (z„)„g]N, {a„)nef<i and {rn)net^ converge linearly to a point 
c 6 A n B. Since Pb is (firmly) nonexpansive, it also follows that (PBJ'fi)neN converges linearly 
to c. Since B is clearly polyhedral at every point in int B it follows from the hypothesis that B 
is polyhedral at c. Lemma [2^ guarantees the existence of no G N such that 


(Vn > no) (r„-PBr„,c-PBr„) =0, 


(64) 


and 


(Vn > no) r„ - Psrn E Nb{c). (65) 

Because of intB 7^ 0 and c E B, Proposition | 2 A^[^ yields Nb(c) n (-Nb(c)) = {0}. 
Hence Nb{c) is a nonempty pointed closed convex cone. Using again 0 E int(A — B), Corol- 
lary | 2 . 1 fi)| gives 

kerP ,4 n Nb(c) = A^ n Nb(c) = { 0 }. ( 66 ) 

In view of Lemma [2..^[ii)t 

K := Pa (^Nb{c)) is a nonempty pointed closed convex cone. (67) 


Combining ( |^ and ( [^ , we obtain 

(Vn > no) fln - fln+l G K. 
Since a„ ^ c and X is a closed convex cone, we have 


( 68 ) 


(Vn > no) a„-c= Y^{ak-ak+i) eK. 

k—n 


We now consider two cases. 


(69) 


Case 1: (3 p > no) flp = c. 

Using a nd ( |^ , we deduce from Lemma 2.6 that a^ = flp+i = c. Now 
Lemma 3.4 yield (Vn > p + 1) z„ = c as required. 


and 


Case!: (Vn > no) a„ c. 

By ( |^ , (Vn > no) an — c E X \ {0}. Since X is pointed (see ^7\), Lemma [23| yields v E 
ri X n ri X® C X such that 

(Vn > no) — c) > 0. (70) 
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Recalling ( |^ , we get u 6 Nb(c) such that v = P^u. Clearly, (Vn > no) — c) — 

{u, Pa (flfi — c)) = {PAU,an — c) = (n, — c). It follows from ( [TO] ) that 

(Vn > no) (n, — c) > 0. (71) 

Since u G Nb{c) we also have 

(Vn > no) {u,PBr„ - c) < 0. (72) 

Now define a linear functional on X by 

/; X^R: (n,x). (73) 

In view of ( [7l| ) with ( |72| |, we obtain (Vn > no) f{zn — Zn+i) = f{an — PBfn) = /(«« “ c) — 
/{PB'fn — c) — {u,a„ — c) — {u,PBr„ — c) > 0. Therefore, 

(Vn > no) /(z„) > /(z„+i). (74) 

However, this and ( [^ together contradict Lemma(applied to (z„)„>„g). We deduce that 
Case 2 never occurs which completes the proof of the theorem. ■ 

Remark 3.8 Some comments on Theorem I3.7l are in order. 

(i) Suppose we replace the Slater condition "A n int B ^ 0" by "A n ri B 0". Then one 
still obtains linear convergence (see ||2T1 Theorem 4.14] or | 6 l Theorem 8.5(i)]); however, 
finite convergence fails in general: indeed, B can chosen to be an affine subspace (see HI 
Section 5]). 

(ii) Under the assumptions of Theorem |3.7| Rockafellar's condition ^7\ is only applicable 
when both A = {a} and a G int B hold. There are many examples where this condition 
is violated yet our condition is applicable (see, e.g., the scenario in the following item). 

(iii) Suppose that X = R^, that A = R x {0} and that B = epi/, where / : X —> R: x i-G- 
|x| — 1. It is clear that B is polyhedral and that A H intB 7 ^ 0 . Define (Ve G R++) 
Ze := (1 + £,£). Then 

(V£ G R++) Tz, = (1 + £,£) ^ Fix T = [-1,1] X {0} yet ||ze - Tz,\\ = e. (75) 
We conclude that (the resolvent reformulation of) Tuque's condition (|4T]) fails. 


4 Applications 

4.1 Product space setup and Spingam's method 

Let us now consider a feasibility problem with possibly more than two sets, say 

M 

find a point in C := Cj, (76) 

M 
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where 


Cl,, Cm are closed convex subsets of X such that C 7 ^ 0 . (77) 

This problem is reduced to a two-set problem as follows. In the product Hilbert space X := 
X^, with the inner product defined by ((xi,..., Xm), ( 1 / 1 , • • • / i/m)) we set 

A ;= {(x,.. .,x) 6 X I X e X} and B ;= Ci x • • • x Cm- (78) 


Because of 


M 

X G Pi Cy (x,..., x) G A n B, 


(79) 


the M-set problem <|7^, which is formulated in X, is equivalent to the two-set problem 


find a point in A n B, (80) 

which is posed in X. By, e.g., ||2l Proposition 25.4(iii) and Proposition 28.3], the projections of 
X = (xi,..., Xm) G X onto A and B are respectively given by 


1 M 1 ^ N 

^ VM ^' M ^^ (J’Cia:!,..., Pcm^m)■ (81) 

j=i j=i 


This opens the door of applying the DRA in X: indeed, set 


T := Id —Pa + PbPa, 


(82) 


fix a starting point zq G X, and generate the DRA sequence {zn)neK via 

(Vn G N) z„_|_i := Tz„. (83) 

We now obtain the following result as a consequence of Theorem |3.7[ 

Corollary 4.1 Suppose that Ci,.. .,Cm polyhedral such that intC 7 ^ 0 . Then the DRA se¬ 
quence defined by ( |83l l converges finitely fo z = (z,..., z) G A n B with z G C = Cy 


Proof. Since intC 7 ^ 0 , there exists c E C and e G IR++ such that (V/ G {1,...,M}) 
ball(c; e) C C. Then (c,..., c) G A n int B, and so A n int B 7 ^ 0. Since B = Ci x • • • x Cm is 
a polyhedral subset of X, the conclusion now follows from Theorem|3.7[ ■ 


Problem ( [7^ was already considered by Spingarn EbU for the case where all sets Ci,..., Cm 
are halfspaces. He cast the resulting problem into the form 

find (a,b) G A x A-*- such that b G NB(a), (84) 

and suggested solving it by a version of his method of partial inverses Il25l . which generates a 
sequence (a„,b„)„g]N via 


(ao,bo) G A X A-*- and (Vn G N) 


•— Psi^n 4“ bn), h'„ :— An -j- bn a],, /or-\ 

lo2) 

an+i := PAa„, b„+i ;= b; - PaK. 
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It was pointed out in HSl Section 1], IIT2l Section 5], IT9l Appendix] and ITOl Remark 2.4] that 
this scheme is closely related to the DRA. (In fact. Lemma |2.17| above makes it completely 
clear why ( |8^ is equivalent to applying the DRA to A and B, with starting point (ao — bo).) 
However, Spingarn's proof of finite convergence in li26H requires 

a„ - a„+i G Nc(c) X • • • X Nc(c), (86) 

and he chooses a linear functional / based on the "diagonal" structure of A — unfortunately, 
his proof does not work for problem Our proof in the previous section at the same 
time simplifies and strengthens his proof technique to allow us to deal with polyhedral sets 
rather than just halfspaces. While every polyhedron is an intersection of halfspaces, the 
problems are theoretically equivalent — in practice, however, there can be huge savings as the 
requirement to work in Spingarn's setup might lead to much larger instances of the product 
space X! It also liberates us from being forced to work in the product space. Our extension 
is also intrinsically more flexible as the following example illustrates. 

Example 4.2 Suppose that X = R^, that A = {(x, x) | v G R} is diagonal, and that B = 
{(x,t/) G R^ I -y < X < 2}. Clearly, B is polyhedral and A H intB ^ 0. Moreover, B is also 
not the Cartesian product of two polyhedral subsets of R, i.e., of two intervals. Therefore, the 
proof of finite convergence of the DRA in Il26l no longer applies. However, A and B satisfy 
all assumptions of Theorem |3.7[ and thus the DRA finds a point in A fl B after a finite number 
of steps (regardless of the location of starting point). See Figurefor an illustration, created 
with GeoGebra |[13|. 



Figure 1: The DRA for the case when B is not a Cartesian product. 
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4.2 Solving linear equalities with a strict positivity constraint 


In this subsection, we assume that 

X = (87) 

and that 

A = {xeX\Lx = a} and 3 = 1!.^, (88) 

where L 6 ^ ^ ]rM js^ote that the set A n B is polyhedral yet A CiB has empty 

interior (unless A = X which is a case of little interest). Thus, Spingarn's finite-convergence 
result is never applicable. However, Theorem |3.7| guarantees finite convergence of the DRA 
provided that Slater' condition 

R++ n L-^a ^ 0 (89) 

holds. Using O Lemma 4.1], we obtain 

Pa: X^ X: x^ x-L\Lx-a), (90) 

where denotes the Moore-Penrose inverse of L. We also have (see, e.g., |2l Example 6.28]) 

Pg: X^X: v = (^1,...,^^) = (^+,...,e+), (91) 

where = max{^,0} for every ^ G R. This implies Ra'- X ^ X: x i-a- x — 2L'^(Lx — a) and 
Rg: X ^ X: x — (^i,...,^ n) (|^i|,..., |^n|)- We will compare three algorithms, all of 

which generate a governing sequence with starting point Zq G X via 

(Vn G N) z„+i = Tz„. (92) 

The DRA uses, of course, 

T = Id -Pa + PbRa. (93) 

The second method is the classical method of alternating projections (MAP) where 

T = PaPb; (94) 

while the third method of reflection-projection (MRP) employs 

T = PaRb. (95) 


We now illustrate the performance of these three algorithms numerically. For the remain¬ 
der of this section, we assume that that X = R^, that A = {(v,y) G R^ | x + Sy = 6}, and 
that B = R+. Then A and B satisfy ( [8^ , and the sequence ( j^ generated by the DRA thus 
converges finitely to a point in A n B regardless of the starting point. See Figure for an 
illustration, created with GeoGebra IITSH . Note that the shadow sequence (PAZfi)nGN for the 
DRA finds a point in A n B even before a fixed point is reached. For each starting point 
Zo G [-100,100]2 C r 2, we perform the DRA until and run the MAP and the 

MRP until dB{zn) = max{dy^(z^),dB(z^)} < £, where we set the tolerance e — 10~^. Figure]^ 
compares the number of iterations needed to stop each algorithm. Note that even though 
we put the DRA at an "unfair disadvantage" (it must find a true fixed point while the MAP 


17 



Figure 2: The orbits of DRA (blue), MAP (green) and MRP (red). 
DRA MAP MRP 



-100 0 100 -100 0 100 -100 0 100 



100 200 300 100 200 300 100 200 300 


Figure 3: Number of iterations needed to get the solution of DRA, MAP and MRP 

and the MRP will stop with s-feasible solutions), it does extremely well. In Figure]^ we level 
the playing field and compare the distance from Pa^h (for the DRA) or from Zn (for the MAP 
and the MRP) to B, where n G {5,10}. 

Now we look at the process of reaching a solution for each algorithm. For the DRA, 
we monitor the shadow sequence {PA^n)nef^ for the MAP and the MRP, we monitor 
(2n)nGN* Note all three monitored sequences lie in A, and we thus are concerned about the 
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DRA 


MAP 


MRP 



-100 0 100 -100 0 100 -100 0 100 



0 5 10 15 0 5 10 15 0 5 10 15 


DRA MAP MRP 



-100 0 100 -100 0 100 -100 0 100 



2 4 6 8 10 12 2 4 6 8 10 12 2 4 6 8 10 12 


Figure 4: The distance from the monitored iterate to B after 5 steps (top) and 10 steps (bottom). 


distance to B. Our stopping criterion is that 

dB{PAZn) < £ 


(96) 


for the DRA, and 


dsiZn) < £ 


(97) 


for the MAP and the MRP. From top to bottom in Figure]^ we check how many iterates are re¬ 
quired to get to tolerance e = 10“’”, where m 6 {2,4}, respectively. Computations were per¬ 
formed with MATLAB R2013b llTSl . These experiments illustrate the superior convergence 
behaviour of the DRA compared to the MAP and the MRP. 


5 The hyperplanar-epigraphical case with Slater's condition 


In this section we assume that 

/: X —> R is convex and continuous. (98a) 
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DRA 


MAP 


MRP 


100 

50 

-50 

-1 00 0 10 0 

100 200 300 

DRA 

50 

-50 

-100 0 100 

100 200 300 


Figure 5: Number of iterations needed to get the tolerance 10 ^ (top) and 10 ^ (bottom) of 
DRA, MAP and MRP. 

We will work in X x R, where we set 



A := X X {0} 

(98b) 

and 


B ;= epi/ := {{x,p) G X x R | f{x) < p} . 

(98c) 

Then 


: X X R ^ X X R: (x,p) i-)- (x,0). 

(99) 


and the projection onto B is described in the following result. 

Lemma 5.1 Let (x,p) G (X x R) \ B. Then there exists p G X such that Pb(x,p) = (p,/(p))/ 


X G p + (/(p) - p)df{p) and p < f{p) < f{x) (100) 

and 

(VyeX) (y-p,x-p) < (/(y)-/(p))(/(p)-p). (101) 




-100 0 100 -100 0 100 



-100 0 100 -100 0 100 



100 200 300 100 200 300 
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Moreover, the following hold: 


(i) If u is a minimizer off, then {u — p,x — p) <0. 

(ii) If X is a minimizer off, then p — x. 

(iii) Ifx is not a minimizer off, then f{p) < f(x). 

Proof According to O Proposition 28.28], there exists {p,p*) € gra3/ such that Pb(x,p) = 
(P'fip)) X = p + (f(p) — p)p*- Next, 12 Propositions 9.18] implies that p < f{p) and 
< |101| |. The subgradient inequality gives 

fix) -fip) > ipfx-p) = ipfifip) - p)p*) = ifip)-p)\\p*\\^ > 0. (102) 

Hence f{p) < fix), and this completes the proof of < |100| l, 

[(i)| It follows from < |1011 l that {u-p,x-p)< (/(u)-/(p))(/(p)-p). Since/(p)-p > 0 
and f(u) < fip), we have {u — p,x — p) <0. 

|(ii)| Apply with u = x. 

[p)| By ([^, p < fip) < fix)- We show the contrapositive and thus assume that f{p) = 
fix). Since f{p) — p > 0, < |102| l yields p* — 0, and so 0 6 0/(p). It follows that p is a 
minimizer of /, and therefore x also minimizes /. ■ 

Remark 5.2 When X = ]R and u is a minimizer of /, then (u — p)(x — p) < Oby 
Lemma [5.1||^i)[ Therefore, p lies between x and u (see also HI Corollary 4.2]). 

Define the DRA operator by 


T:=ld-PA + PBRA. (103) 

It will be convenient to abbreviate 

B' ;= RAiB) = {{x,p) G X X R I p < -f{x)} (104) 

and to analyze the effect of performing one DRA step in the following result. 

Corollary 5.3 (one DRA step) Let z = (x,p) G X x R, and set 2 _(_ := (x+,p_(_) = T(x,p). Then 
the following hold: 

(i) Suppose that z G B'. Then z+ = (x, 0) G A. Moreover, either (fix) < 0 and z+ G A n B) or 
(f ix) > 0 and z+ ^ B U B'). 

(ii) Suppose that z ^ B'. Then there exists x+ G df{x+) such that 

x+ = X - P+X+, /(x+) < /(x), and p+ = p + /(x+) > 0. (105) 

Moreover, either (p > 0 and z+ G B) or (p < 0, z+ ^ B U B' and Tz+ G B). 
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(iii) Suppose that z E BOB'. Then z_|_ € A n B. 

(iv) Suppose that z E B \ B'. Then z_(_ E B. 


Proof. We have P^z = {x, 0) and R^z = (x,—p) E B. Thus PbPaz = Pb {x, —p) = {x, —p), 
which gives 


z+ = (Id-P a+ PbRa)z = {x,p) - (x,0) + {x,-p) = (x,0) e A. (106) 


If/(x) < 0, then Z-(_ = (x, 0) E B, and hence Z-(_ E An B. Otherwise, /(x) > 0 which implies 
—/(x) < 0 and further z+ = (x, 0) ^ B U B'. 

|(ii)| We have Raz = (x, —p) ^ B, and by ( |100| l, Pb(x, —p) = {p,f{p)), where 

p = X — {p + f{p))p* tor some p* E df{p), and — p < f{p) < f{x). (107) 


We obtain 

z+ = (x+,p+) = (Id -Pa + PbRa)z = (x,p) - (x,0) + (p,/(p)) = (p,p + f{p)), (108) 

which gives x+ = p and p+ = p + f{p) > 0, so ( |105| l holds. If p > 0, then p+ = p + /(x+) > 
/(x+), and thus z+ G B. Otherwise, p < 0, so p+ < /(x+) and also /(x+) > —p > 0. Hence 
p+ > 0 > — /(x+), which implies z+ ^ B U B', and then Tz+ 6 B because p+ > 0 and the 
previous case applies. 

We have /(x) < p < —f{x), and so /(x) < 0. Now appiyH 

We have p > /(x) and p > — /(x). Then p > |/(x) | > 0, and |(ii)| gives z+ G B. ■ 

Theorem 5.4 Suppose that mix f < 0, and, given a starting point zq = (xo,po) G X x R, generate 
fBe DBA sequence (z„)„g]N 

(Vn G ]N) z,j-|-i = (x,j-|-i, p,i-|-i) = Tzjj. (109) 

TBen (z„)„g]N converges finitely to a point z G A n B. 


M 


Proof In view of Corollary |5.!^|^i)^j(iii^ we can and do assume that Zq G B \ B', where B' was 
defined in (|104|l. It follows then from Corollary 5.2 'iii) & (iv) that (z„ )„e][s[ lies in B. 


Case 1: (3n G N) z„ G B n B'. 

By Corollary |5.!^|^iii)| Zn+i G A fl B and we are done. 


Case 2: (Vn G N) z„ G B \ B'. 
By Corollary |5.!^[ii)| 


(Vn G N) /(x„+i) < f{x„) and Pn+1 — Pn + /(x„+i) > 0. (110) 


Next, it follows from Il22l Lemma 7.3] that intB = {(x,p) G X x R | /(x) < p}. Because 
infx/ < 0, we obtain A n intB 0, which, due to Lemma |3.2|[i)| yields z„ —> z = (x,p) G 
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Ar\B. Since z E A, we must have p = 0. If (Vn € N) /(x„_|_i) > 0, then, by ( |110| ), 0 < pi < 
pi < ■ ■ ■ < p„ ^ p = 0 which is absurd. Therefore, 


(3noeN) /(x„o+i)<0. 


(Ill) 


In view of ( |110| l, we see that (Vn > no + 1) Pn < Pno + (^ 
there exists ni G N, ni > no + 1 such that 


no)f{x„o+i). Since f{x„g+i) < 0, 


pno + (ni - no)/(x„o+i) < -/(x„o+i). (112) 

Noting that /(x„j) < /(x„g+i), we then obtain 

Pm < pno + {ni - no)/(x„„+i) < < -/(x„J. (113) 

Hence G B', which contradicts the assumption of Case 2. Therefore, Case 2 never occurs 
and the proof is complete. ■ 


We conclude by illustrating that finite convergence may be deduced from Theorem |5.4| but 
not necessarily from the finite convergence conditions of Section [2^ 

Example 5.5 Suppose that X = R, that A = R x {0}, and that B — epi/, where / : R ^ 
R; X I— y x'^ — 1 . Let (Vs G R-1--1-) Zg — T —^)* Then (Vs G R-1--1-) Tzg ^ Fix T — [— 1 , 1 ] x 
{0}, and Zg — Tzg ^ 0 as s —> 0+. Consequently, Tuque's condition (|4T|| fails. 


Proof. Let s G R++. Then —/(I + s) = —2e — s^ < —s, and so Zg = (1 + s, — s) ^ B' . By 
Corollary |5.:^(ii)[ there exists Xg G R such that 

Tzg = (Xg, -S + /(X£.)), Xg = 1 + s-(-s + /(xe))2x£, and -s + /(xg)>0. (114) 


The last inequality shows that Tzg ^ Fix T = [—1,1] x {0}. It follows from the expression of 
Xg that 


2Xg — (1 + 2e)xg — 1 — s = 0. 


(115) 


Note that (xg, f (xg)) + (0, —s) = Tzg — z^ — Pa^e + PbBaZe — (1 + £/ —s) — (1 + s, 0) + Pb( 1 + 
s,s) = Pb(1 + £,£) + (0, —s) and hence (xg,/(x£)) = Pb(1 + £,£)■ Remark 5.2 gives 0 < Xg < 
1 + s. If 0 < Xg < 1, then < |115| l yields 0 < 2xg — (1 + 2e)xg — 1 — s = (xg — 1) — 2exg — s < 0, 
which is absurd. Thus 1 < Xg < 1 + s. Now as s —)■ 0+, we have Xg —> 1, /(xg) ^ /(I) = 0, 
and at the same time, Zg — TZg = (1 + s — Xg, —/(xg)) ^0. ■ 
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